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ABSTRACT 



Properties of a stationary sequence of random variables {x^} 
which have exponential marginal distributions and random linear 
combinations of order one of an i.i.d. exponential sequence 
were discussed by Lawrance and Lewis (1976) ; they called this model 
the EMAl (exponential moving average of order one) point process. 
This paper will investigate the estimators of the parameter 3 of 
the EMAl process, and some basic properties of the EMA2 process, 
and then extend these results to the EMAk process. 
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LIST OF SYMBOLS 



X. 

1 


The ith element of the sequence of the time intervals 
of the point process. 


e. 
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The ith element of the i.i.d. exponential sequence 
with parameter X , 


EMAk 


Exponential Moving Average of order k. 


3. 
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Probabilities, 0<3.<1/ i=l,2,3, 




The jth order serial correlations. 


T 

r 


Sum of X.'s; T =X.+X^+ +X . 

1 r 1 2 r 


(f) (s) 
r 


— sT 

Laplace transform of the p.d.f. of T^; (})^(s)=E(e r) 


p.d.f . 


Probability density function. 


F^(t) 


Distribution function of T . 

r 

The number of events occurring in the time interval 

(f) t 


(z; t) 
(z; s) 
(t) 

* 

(s) 


The generating function of ; E(z ). 

Laplace transform of ij;^(z;t). 

The intensity function of the point process. 
Laplace transform of m(t). 
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Parameter of exponential distributions. 
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Variable of Laplace transform. 
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** 

S'Vl'=l'®2> 


_sX 

Laplace transform of the p.d.f. of X^; E (e i) . 

Laplace transform of the joint p.d.f, of X. and 


/\ /\ 
3, 3 


Estimators of 3 • 
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■D> 
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Random variable Y divided by its mean value, i.e. 
Y ' =Y/yy . 


/s 


Estimator of p. . 

J 


ip(s) 


Laplace transform of the p.d.f, of the e. 
distribution . 




Joint p.d.f. of and , . 

^ 1 JL ^1 JL+1 


x."^> 

1 


X. of the EMAk process. 

JL 


Q. 


The jth order serial correlation of the EMAk process 
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I . INTRODUCTION 



Properties of the stationary sequence of positive random variables 
{x^} v;hich are formed from an independent and identically distributed 
exponential sequence according to the linear model 

with probability 3/ 

(0^3^1;i=0,±l,±2,. . .) 

3C.+5 with probability 1-3. 

1 1+1 




were discussed by Lawrance and Lewis [Ref. 1] . They gave a fairly com- 
plete picture of this model, and called it the EMAl (Exponential Moving 
Average of order 1) process. It is clear that the adjacent elements of 
this sequence are correlated, but that the dependence is no greater than 
order one, i.e. X. is independent of X. X. ... and so forth for 
pairs and triples. 

In this paper, methods of estimating 3 ^nd the properties of the 
estimates of 3 v/ill be discussed, and then the properties of an 
analogous second order process are investigated. The new process, called 
the EMA2 model, is a sequence of positive random variables defined 

by 



X.= 

1 



w . p . 3 ; 

2 



re 5. 

2 1 

e c.+e K, 

2 1 1 1+1 

^3 5 .+3 ^ ^ +5 . . w.p. (1-3 ) (1-S ) . 
2 1 1 i+1 1+2 2 1 



W.p. (1-3 )p/0-3 /3 -1 ; i=0 , ±1 , . . . ) ; 
2 i 2 1 



( 1 . 1 ) 



The purpose in the creation of this model is to provide models for 
data v;ith longer dependencies than that obtained with the first-order 
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model and to examine any tendencies of the upper bound on the serial 
correlations to increase. For the EMAl model 0_<p <1/4 and P, =0 for 

J- jC 

k=2, 3, ...... . For the EMA2 model it is shown that 0_<p^, p^_<l/4 and 

p =0 for k=3,4,... In fact, the {x.} form a sequence of exponential 
k 1 

random variables, and it will be seen from (1.1) that the successive 

elements X., X. w X. ^ will be correlated. This model is also an 
1 1+1 1+2 

alternative model to a renewal process. 

The EMA2 model is shown to be a stationary point process. Distri- 
bution of the sums of X^ are discussed, and the joint distributions 
of two adjacent inteir^als X^ are derived and appear to be new bivari- 
ate exponential distributions. Extensions of the model and estimation 
problems are briefly discussed. 

In developing the properties of the process, the similarities to 
a backward second order moving average which is defined as 



rB C. 
2 1 



X.= 

1 



5 .+8 

2 1 



1-1 



S.+B 

2 1 




w . p . B ; 

2 

w. p. (1-3 ) B (0~3 

2 1 2 

w.p. (1-3 ) (1-3 ) . 

2 2 1 



3 ^l;i=0,±l 

1 



( 1 . 2 ) 



will also be pointed out. Properties of the processes are very similar, 
but those of the forv;ard model (1.1) have simpler derivations. 
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II. A BRIEF REVIEW OF THE EMAl PROCESS 



The EMAl model is a stationary point process with exponential mar- 
ginal distribution of the intervals • Further is dependent 

on ^ and independent of all others, so the correla- 

tion p = corr(X.,X ) = 3(1“3)/ P,=0 for k=2,3,.... 

X 1 1 I X X 

The Laplace transform of the p.d.f. of T =X^+X_+...+X is 
^ r 1 2 r 



A r A (A+23s) 1 r-1 

<j) (s)= J (2.1) 

A+s l(A+3s) [A+(l+3) s]) 



Let t>e the nxamber of events occurring in the interval (0,t] be- 

ginning at an arbitrary event; and let F^(t) denote the distribution 

of T ; then 
r 

Prob{N^^^=r}=F (t)-F , (t) . r^O 

t r r+1 

with F^(t)=l for t>0 . The p.d.f. of gives the generating 

function as 

cc oc 3--1 

E[z ^ (z;t)=E z^[F (t)-F , ( t) ] =1+ (z-1) E z F (t).(2.2) 

f r r+1 r 



Inserting (2.1) in the Laplace transform of (2.2) gives 



* 3 ( 1 + 3 ) s^+ [-3 (1-3) z+23+1] As+A^ 

4 > (z;s)= — (2.3) 

^ ' (s+A) [3(l+3)sn(l+23-23z)As+(l-z)A^] 



10 



Differentiating (2 ,3) with res£)ect to z , then setting z=l , gives 



the Laplace transform of the intensity function 



m^(t) 



as 



* X (x+3s) [X+(l+e)s] 

m (z;s)= , (2.4) 

f 3(l+e)s(A+s) [s+X/(3^+3)] 



and inverting (2.4) gives 



(t) = { 



A{1+ 



B(l-B) , -Xt/(B2+B) 



-Xt 

-e 



]} 



X(l+B^Xte“^^) 



(62+e=i) 



The joint distribution of and ^^^ 2 . ^ bivariate exponen- 

tial, Using a double Laplace transform we get 



** 



(3s^) [6^ (Ss^) + (l-'3) (s^+Bs^) ] [B+(l“B)il^ (s^) 3 



X^ (X+Bs^+Bs^) 



(X+Bs^) (X+s^) (X+s^+Bs^) ' 



(2.5) 



and using triple Laplace transform gives 






=\l> (Bs^) IBiJ^ (^s^) + d“B)<l' (s^+Bs^) ) [Bif- (Bs^) + (1 -B)<Ms2+Bs^) ] [B+(l-3)<i' (s^) ) 

Differentiating (2.5) with respect to s^ , setting S2=0^, and 
inverting with respect to s^ and then dividing by the marginal (exponen- 
tial) density of / gives 
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similarly, 



, -1 „ -d-B)Xt/B, 

E(X. X., =t)=X [1+B-e ] 

1 ' 1+1 



The two conditional variances are given by 



... I.. ,-2 1-2B+26® , 262(i+xt) .-(l-B)Xt/6 B^ -2(l-B)Xt/Bl 

var(xjx..^-t).x 1 + -^71 — a ‘ oIbP' ** J 



Var(xJx.^^.t).X-2 (i±|i£z6i ^ ,-X (1-B) t/6.^-2 (1-B> Xt/B, , 



1-8 B 
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III. ESTIMATING g IN THE EMAl MODEL 



The EMAl model is not time-reversible, and this comes out clearly 
in higher order joint moments. The results lead to a method for esti- 
mating 3 in the EMAl model. 

Define , (h)-E (X. -E CX . ) E ) , 

C2_,(k)-E(x2x.^^)-E(x2)E(X.^^), 



which when k=l gives 



C^_2a)=E0<i>:i+l)-E&i)E(xJ^l)^ 

C2,,(l).E(xJXi^^)-E(X^)E(Xi^^). 



By the construction of EI4A1, we have: 



2 

={ 



w.p. 



w 



.p. (1-B)^. 



(0<B^1; i=0,±l,±2,. ..) 



Hence, using straightforward combination, we get the joint expectation 



- ^ 

of X. and X. _ as 
1 1+1 



E(X^Xi^l)=E( B^+E( 

+E (B?e?e: . ^.^+2B2 g ) B (1-B) ^ 

+E(B3e2e.^^+2B^r..c2^;,+62e2c.^2+2Be.E^+;LGi+2^BG3^^+^ (1-B)^ 



Simplification of this result leads to 

E(X^X.,-)= --^(2+43-“23^-‘23^) which implies that C .(1)= -" 3-3 (1“3) (2-i-3) • 
1 x+1 A 2 , 1 A 
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similarly, we get 



_1 (2+23-26^) ''^hich implies that 

^ i i+1 

Therefore, if we let 



C 



1|2 



( 1 ) = 




Cl-6) (1+B). 



r= 




( 1 ) 

uT 



(2+6)/(l+6) , 



( 3 . 1 ) 



we have a function of 3 which decreases monotonically from 2 when 
, to 3/2 when 3"^1 • Thus there is a unique solution for 3 for 
any given r ; note that when 3 is 0 or 1, the ratio is not defined. 
Solving ( 3 . 1 ) we get 



2 - 






3=(2-r)/(r-l) = 






- 1 






For estimating 3 / define 



1=1 

/N 1 2 -2 - 



Thus 



B= 






Now we check all the estimators, to see if they are asymptotically 
unbiased or not. 

1=1 1=1 1=1 



1 . 
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Examining the estimate of the product of the means we have 

I X. • j xJ={X^+X2+...+X_^) (X^+X^...«J) 

-nxj+2(n-l) (X^xJ^^+X^Xj^^j^ ) + (n-l) (n-2)Xj^X^j.2 



Thus 



E( 



1 



Yx. )= -^- 4 ^ [6n+2(n-l) (4+6B-2B^-4B^)+2n^-6n+4] 

X ^ X. TV- 

i-i i=i 

r= -|^4--^(2+3B-B2_2g3)+ 4 , 

n n 



— 2 Q 

and when n-^ , E (XX )->2/X. 



Thus, since the estimators of 
we get that asymptotically, 





and 


of E(xfx.^^) 


Era^ 


2 


^ 3(1-3) (1+3) ; 


Eia^^^d)). 


2 


: 3(1-3) (2+3) . 



are unbiased. 



1, e. Both of these are unbiased estimators when n is large. 

/s 

2. We now look at the ratio estimator of 3 f namely 3 to see if it 
is asymptotically unbiased. Note that the denominator in the expression 
for 3 is identically zero if 3=0 or 3=1 » so that in what follows 
we assume that 0<3<! . Let 






C2^l(l)-Ci^2(l^'"'^' Then 



-^(2B2-2B3)=y^; and 

E(Z)= E[1 . (1)]-E[C^ „(!)]= -4r(23-232)=y^. 

2,1 1,2 .A z 

. y y/y y 

Now we can write (Y/Z)= z — = — Y* (1+ ) 

y z/y y y 

z z z z 

EtY/Z)= {e(Y*)-E[Y‘ (- ^)]+E[Y* }; 

^z ^z ^z 



where Y‘=Y/y^, so that 



(3,1,) 



we assume that conditions for this expansion to hold as n-^ are met. 



15 



since U /U =3 and E(Y')=1 , if 3=Y/Z is to be unbiased, we 
y z 

must show the rest of the terms in (3.1) are all zeros, 
yhus look at 

E[Y' (Z-y2)/yz]=E(YZ)/yyy^-l. 

we have 



(YZ) = [2C^ 2 



n-1 

Z 

.=1 

n-1 



n-1 



n-1 



n-1 



=(n-l)-2|2 Z Z X?Xi HE x2x - Z X X 1 

i=l 1 i=l 1=1 1=1 



n-1 



.-2. ,.2 



-(x)(x^)( Z x:x - Z X X. ,)/(n-l) 
i=l 1 i=l ^ 

2 ^ 



=[ (2U-W) (W-U) ]/(n-l)^-[ Z X. Z xJ(W-U) ]/[n^(n-l) ] , 

i=l ^i=l 



where 



and 



n~l 

u= z x.x^ 
i=l ^ ^+1 
n-1 

W= Z X^X. , 
i=l 1 1+^ 



n-1 
Z U . , 
i=l ^ 



n-1 

^ Z W. , 
i=l ^ 



i.e. U .=X.Xt^ , 
1 11+1 



i.e. W =X^X.^^. 



In addition (2U-W) (W-U) =3UTV-2U^ -W^ . 



Further we get 



n-1 n-1 n-1 n-2 

UW= Z U.W.+ Z U.W. Z U.W. + Z U^W._^T 

i=l ^ ^ i=3 ^ ^-2 i=2 1-1 i=l ^ 1-"^ 

n-3 

+ Z^U^W^_i_2+ (n^-7n+12)U^W^^3 , 



_ n-1 „ n-2 n-3 

U^= Z U":+2 Z U.U. ,+2 Z U.U. ^+(n~3) (n-4)U,-U- , o 
i=l 1 i=l ^ i=l ^ ^+2 1 



2 ^:1.2 ^^"2 



n-3 



W = Z W. + 2 Z W.W. ,1+2 Z W-W._^o+ n-3) (n-4 W.W. 

. ,1 . 1 1 1+1 . 1 1 1+2 1 i±3 

1=1 1=1 1=1 



16 



It can be shown that all these joint expectations have finite expected 

value so, when n-x» , those terms only with coefficients n will go to 

1 2 

zero when multiplying by • Thus asymptotically. 



E[ (2U-W) (W-U)/(n-l) 2]=E(3UW-2U^-W^)/(n-l) 2-- 

3E (Uj_)E (W. + 3 ) -2E (Ui) E (Ui^3) -E (W. )E(Wi^ 3 ) = (46-46^ + 46 '- 86 ‘‘ + 43') AS 



Since 



and 



E(U^)=E(X^xf^^) = (2+26-23')/X^ , 

E {VI =E (X?X^_|_j^) = (2+4 3-23^-23 ^ ) /X ^ , 



n n 

Similarly, E[ Z X. Z xf (W-U) / (n -n) ] 



i=l -^i=l 

E(X^)E(xJ) [E(W^)-E(U^) ] = (43-43^ )/XS 
1 3 4 5 

Hence, E(YZ)= — (43 -83 +43 )/ when n is large. 

x^ 

Asymptotically, 

E[Y' (Z-y2)/y2] = (46'-83'*+43")/(yyy^X')-l=0. 

In (3.1), the rest of the terms in the braces will also approach zero 

>N /S. 

when n is large, so E(3)=3f i.e. 3 is an unbiased estimator. 

An alternative way to estimate 3 is to use 



3=[X^C (l)]/2$ -1 



1 I 2 



where is 


an estimator 


of 1 


of EMAl, and 


p^=3(i-3) . 


[Ref 


Define a 


n-1 




P 


=X^ [ Z X.X 
^ i=l ^ 


i+1^ 


Then 


n -1 





r-s 2. 



A ^ 0 

E(p )=XA Z E(X.X .^3 )/(n-l)-E[ ( ^ X.) ]/n2} 

i=l ^ ■ i=l 
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Again using the same argument as above, we have 



E(XiXi^l)=(l+B-6^)/X^. 



Also 



so that 



2 n 2 

'' ".+2 Z X.X.^,+2 Z Z X.X. , . , 
i=l ^ i=l ^ i=l 3=2 ^ ^+3 



n 9^2 

( Z X . ) = Z X.+2 Z X.X. , t+ 2 Z 
i=l 1 



E[(x)^]=n 2[2n/X^+2 (n-1) (1+B-B^)/X^ 



+(n-l) (n-2)/X^] 



n-><x 



^l/X^ . 



Consequently E(p^)=XM (n-1) (l+3-3^)/[X^ (n-l)]-E[ (x)^] } 

/s 

Thus is an unbiased estimator for when n is large. 

3 /N /\ 

Now assume n-^ and let Y=A C ^(1) and Z=2p . Thus 

1/2 1 

E (Y) =23 (1-3X1+3) / and E (Z) =23 (I- 3 ) , 



n->oc 






and by the expansion used above 



E(Y/Z)=-^{E(y’)-E[Y' ( ) ]+E[Y' ( )^]~ } (3.2) 



y. 



We want to show that the terms in (3.2) beyond the first are zero, so 
we look at 



E[Y' {Z-\i^)/\i^]=E{YZ)/\i^m^-1. 



We have 

(YZ)=2X^P^Cj^^2(1)=2X 



n -1 n . 

[ 2 X^X /(n-l)-( Z X./n)^] 
i=l ^ i=l "■ 



n -1 2 ^ ^ 9 o 

[ Z X.X. i/(n-D- Z X. Z X /n^]. 
i=l ^ ^ i=l ^i=l ^ 



6 ( 1 - 8 ) 
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Therefore 



n-><^ 



E(YZ) -^2X^ [E(X^Xj^_^j^)E(X^X^ I^j^)-E(X^X^^^)E(X^)E(X^) 

-E(Xj^)E(Xj^)E(X^X?^]^)+E(Xj^)E(Xi)E(Xj^)E(X?) ] 



=4(3^-P'-3'* + e') , 



SO that, 

E [V ■ (z-y^) /y^i ■ 

Similarly, we can show the rest of the terms in the braces of (3.2) all 
approach zero when n is large. Hence 

E(3)=E(Y/Z) -l=l+3-l=3, 

i.e. 3 is also an unbiased estimator of 3 when n is large. 
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IV. COMPARISON OF THE ESTIMATORS 



/S /\ 



It has been shown in the last section that the two estimators 3/ 3 
are unbiased asymptotically, provided that 3/^0, or 3 t^ 1, but when the 
sample size n is not large enough, the bias term should be considered. 

For simplification, any finite term divided by the second or higher power 
of n will be neglected. 

For 3 / let 2 1^^^' 2^^^* esti- 

mators here are defined as before. Thus 



E(Y)=23^ (1-3) /A ^-4 (2+33-3^-23^)/nA'=y^; 
E(Z)=23{l-3)/A^=y^; 

E(Y/Z)=u u"^{l-[E(YZ)/y^ u,-l]+ } . 

y z. y 

Using those results listed in APPENDIX B and neglecting the higher power 
terms , we have 

E(YZ)=E(Y)E(Z)+ (-12-5603+14723 ^-114 83 ^+5323“ - 11203 ^ 

+7403'^+2483’-1643®)/(^’1- . 

Hence E(3) = [ 2 Uyy 2 "^(^ 2 ) ]/y^ 

1 1 

=3+ (12+5283-14 883^+12123^-5163“ 

43M1-3)^ n 

+10883^-7403^-2483^1643®) . (4.1) 

^ 3 /% y\ 

For 3 , let Y=A * 
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Again all the estimators here are defined as before. Thus 

E(Y)=23(l-e) (l+6)-4(2+36-6"-26M/n=yy, and 

E(Z)=2B (l-&)+(2+4B-4B")/n=y2- 

2 

In (4,2) f the maximum value of (2+43--4g ) occurs at 3=1/2 , and 
equals to 3, when divided by n, it can be neglected, so y^=23(l“3) . 

Similarly as above we have 

E (YZ) =E (Y) E (Z) + (4-166+343^ + 243 ^-26 B“ + 86^-24eM/n , 

and consequently 

E(f)=3+ — (-4+163-223^-323^+143“+243M . (4.3) 

43M1-3)^ n 

Now compare (4.1) and (4,3); both of them are divided by 
2 2 

4 3 (1“3) • When 3 approaches 0 or 1, the values of bias term will 

be very large, though both of the sums of the coefficients of the 3*s 
in the parentheses are zero when 3 approaches 0 or 1. Figures 1 to 4 
give the shape of the curves of f(3) ^nd bias for different values of 

O' ^ 

3 . From the figures it is obvious that 3 is better than 3 • 

The variances of those estimators are very messy for hand computa- 
tion, and have not been worked out for this thesis. 
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V. SOME BASIC ASPECTS OF THE EMA2 MODEL 



The simplest aspect of the EMA2 model is the exponential marginal 



distribution of the intervals point process terminology 

[Ref. 2] this is the synchronous distribution of intervals and refers 
to the distribution of the interval from an arbitrarily chosen event to 
the next two events. For the Laplace transform of its probability den- 
sity function (p.d.f.) f (x) , we write 

X . 

~sX. 



f* 



( 5 . 1 ) 



using (1.1). Since the i.i.d. random variable have exponential 

distributions with parameters X , their Laplace transform is A/(A+s) 
Thus (5.1) becomes 



A 



A•^s • 



This demonstrates that the have identical exponential distributions 
as asserted. The parameter X is the number of events per unit time 
or the rate of the point process. 

The correlation between X. and X. , can be obtained on considering 

1 1+1 

the product of X^ from (1.1) with 






^Z^L+1 


w,p 




w,p 


i-M*’’ Pl^l+2'*'^i+3 


w.p 



2* 
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Thus, again using straightforward conditioning arguments, 



l^i^l+2^ ^2^1^i+3^ ^2 d- 
?2?i^i4-l'*' P2^i+l^l-}-2^ ^2^ ft ) 

‘*'®^?2^i^i+l'^'^ft^l^i+2'^?2^i^i’{-3**‘feft^i+i'*^l^i+l^i+2 

‘*‘^^?2^i^i+l’*' ?2 ft^i^i+2'''' ft f2^i'M'^ft'^i+i^i+2'^(^2^i+l^i+2 



and simplification of this result leads to 

1 



f^«=corr(X^,X 



1 + 1 - 






cov(\»^l+l- 



( varXj^ «, varX^^^ )^ 



?l(l-fe)[l-?l(l-p2)J 



( 5.?0 



Similarly we have 



P2«=corr(X^,X^^2)°^2^^“ft^ ^^'ft^ 



(5.3) 
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By the 


construction of 


EMA2, 


p^=0 for 


j^3 . 


The result 


for 


(5.2 


equals 


zero when 32=^ 


and 


3j^=l , or 


32=1, 


or 3^=0 ; 


and 


will 



approach its maximum value at . This occurs when 

. 3^=1/ [2 ( 1 - 32 ) ] • result for (5.3) equals to zero when t 

or 3j^=l r or 32=1 / will approach its maximum value at 32 = 1/2 

and 3^=0 • Therefore, the serial correlations of EMA2 are all non- 
negative and bounded above by 1/4. 

Now the stationarity of the EMA2 process will be discussed. 

Define B(X.)=m(i) (5.4) 

E[x^-m(i)] i-(.k)j =Cov(X^ i , ifk) . (5.5) 

A stochastic process with a discrete time parameter is said to be 

"stationary*' (or stationary in the strict sense) if the distribution of 

X. , X. X. . is the same as the distribution of X. , , 

1 1+1 1+3 i+k 

^i+j+k ' every finite set of integers {l,2 j} 

and for every integer k . This definition is equivalent to requiring 

that the probability measure for the sequence same as that 

of every integer k . If the first-order moments exist, 

stationarity implies that E(X.)=E(X. ) for all i,k=0, +1, j^2,...(5.6) 

Since (X. ,X. ., ) has the same distribution as (X. , ,X. ^ , existence 

1 1+1 i+k i+l+k 

of the second-order moments and stationarity imply 

a(i,i+j)=a(i+k,i+j+k) . (5.7) 

Setting k= -i-1 gives a (i , i+ j ) =0 [i- (i+ j ) ] =0 ( j ) . (5.8) 

* 

In the norraal case properties (5.6) and (5.7) determine that the 
stochastic process is stationary. 
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A stochastic process is said to be stationary in the wide sense or 
weakly stationary or stationary of second order if the mean function 
and the covariance function defined as in (5.4) and (5.5) exist and 
satisfy the relations (5.6) and (5.7); i.e. the mean is a constant, in- 
dependent of time, and the covariance of any two variables depends only 
on their distance apart in time. Obviously, any process which is 
stationary in the strict sense and has finite variance is also stationary 
in the wide sense. In the normal case discussed above stationary in 
the strict sense and in the wide sense are equivalent. 

We have proved that the have identical exponential distributions, 

which implies that E(X^) exists and E (X^) =E (X^_^j^^ for all i , k=0, +^1 ,jf 2 , 
. . . Also we have 

C0v(Xj^8X^^)- 

C0v(x, ,X^^)«= » 

cov(X^,^j^^)“ 0. for 

All these expectations and covariances are independent of time i, so we 
conclude that the EMA2 process is stationary in the wide sense. 

The independent exponential sequences and EIlAl models are the special 
cases of the EMA2 model; these aspects of the EMA2 model are described in 
the following table: 
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Values of ^2 
in EKA2 Bodel 


When we set 


eeq.u®nce reduces to 


fz” °< ?r?i 


£i+i“k 


model 






EJIAI model 


?r ° 


Now the adjacent 
elements are indep» 
if keep no change 


EMAl model 






Poisson process (i*i,d) 


p2“ 0tPj*=l 




Poisson process (iei.d) 


Of 0 


"•P- 1 


Poisson process (i.i.d) 



This gives checks on most of the results, for the serial correlations. 

In the 3rd case and are independent, so p^=0; but and 

X. are dependent, so p =3^(1”3^) / which is the same expression of 

in EMAl. The serial correlations in the last three cases are all 
zero, since all of them have i.i.d. elements. 

Also, even the backward model (1.2) could be equally treated to 
produce similar but different results. However, there is no time-reversi- 
bility in the process, in the sense that {x^,X 2 / X^l does not have 

the same joint probability distribution as * * * *^-k^ 

finite k, where k>2 . 
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VI . DISTRIBUTION OF SUMS IN {x ^ } SEQUENCE OF THE EMA2 MODEL 



In the point process theory of the model, the distribution of the 

sums T =X^+X^+..,+X are very useful; if these can be obtained then 
r 1 2 r 

the distribution of counts, both in the synchronous and asynchronous 

mode, can then be derived. It would, therefore, be a particularly 

attractive feature of the EMA2 model if the distribution of the T could 

r 

be obtained. Unfortunately, it is not possible to get a simple expres- 
sion of the Laplace transform of the p.d.f. of T as in EMAl . 



However, a general derivation will now be given. Define i|Us) as 
the Laplace transfonn of the p.d.f. of the distribution; except 

where otherwise remarked this distribution is exponential of parcimeter 
X and so (s) =A/ (X+s) . Define the triple Laplace transform of the 



r 



p.d.f. of T , e , and e ^ as 
r r+1 r+2 





f • • e 6 • • 



( 6 . 1 ) 



For r=l , we have 
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Now we relate ' ^2 ' ^3^ using the expression 

K.p. 

Then we have 



“ ^r-1 »®2^ 

■^^r-l^®l‘’fe®l#Pl^l‘^2)[Pl(i**^)\Ko2)+(l~{^)(l-'(^j^)l/'(Sj-h3^)J, 

Continuing, we can write 

<^r-l (°1' •^Z^‘’4’r-Z^“l ‘^2®! • ?2®1 ^ 

4*r-l ' ft®l'‘®2^“4r-2^®l • ^®1 ’ fe® 1 ^^^?l®l'*®2^?2 

[?1 (I-|)'//( PlS^•^32)+(l.fJ ) (1-|) t//(3 j+pjGj-te^) ] . 



and solve it recursively; the procedure is difficult by hand but could 
possibly be manipulated on a computer. Setting ^^=0 and s^=0 , we 
have the Laplace transform of the p.d.f. of T^ . 
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The first few sums have transforms as follows: 



({)^{s,0,0)= which implies that exponential (X) as is 



expected. For we have: 






If we let ' (6.2) reduces to 






the Laplace transform of the p.d.f. of in EMAl. [Ref. 1, p.8] 

X 2 

If we let 3n=0 , (6.2) reduces to (t— ) which implies that T 

1 A+s 2 

is the sum of two independent exponential random variables. 



For V7e have 



A 



A*((a)(b)+(o)(d)J 



<^{•..0,0)"^^ J (A-hs+p^a J (Vs-i-(3j3 J ’ 

Bhera A.(s2(2f|+3^jf2-''(^?2)+A=:(3?2'*'2Pl)+A^J(l-p2) (6.3) 

D=s3(2p|44p^p2^2pip2)+,js2(jj32+6,3jf2*^)-'S^A('tP2'*2Pi)+A^ 



If we let zero or one, we have some interesting results. 

V7hen ^ 2 ^^ ' (A) (S) (X+23^s) ^ and (C)(D)=0 , so that (6.3) 

reduces to / ^ v 2 

A-tu [ (A+p^s'rs)(A+Pje) J 

which is the Laplace transform of the p.d.f. of in EMAl for 3=3^^ • 
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When 



^^=1 , A=( 1- (3^) (A+ (32S+2S ) (A+2 p^s ) , B^CA+PgS ) C\+2s ) (\43+ p^s ) , 
C“^(A+2s)(A+2s+P2s) and (Ma-frP^n)^ t 

and this will give the same result as above for 3=32 ’ 

When 

(A)(B)° 0, (C)(D)»(A+2s+P^s)(A-te+Pjs)3(A+2s), 

3 3 

(6,3) reduces to A /(A+s) , indicating that the {x^} sequence are 

i . i .d. exponentials . 

When 



0, A=(i-P2)(A+p2s)C\+2P2s), B«AC\+p2s)(^‘*^'^?2®) » 

C=> P2® ^ 



SO that ( 6 . 3 ) reduces to ^ ^ \ 

, , A(^+2fes) 



which means and X^ form an EMAl model, X^ is exponential (A) 

and independent of X^^ and X^ . 
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IN EMA2 



VII. THE JOINT DISTRIBUTION OF X. AND X. , 
1 1 + 1 - 

We now discuss the joint distribution of X. and X. , which will 

1 1+1 

be a bivariate exponential distribution. Several authors have discussed 
bivariate exponential distributions, including Downton (1970) , v;ho makes 
some comparisons with those of Gumbel, Moran and Marshall-Olkin . The 
distribution to be discussed here does not appear to be one of the 
earlier ones, although it is fair to say that in common with earlier ones, 
it is not the 'perfect* bivariate exponential. 

The double Laplace transform of the joint p.d.f. of X^ and 
easily calculated using (1.1); the required expectation is 



“S.X, 



E 












j;-fe®i£i-®2(p2£i+r?i£i+2*^i+3^p^(i.|3^)(i.pp 



+E 

+E{e 









+E 

+E 

+E 

+E 

+E 



I'g”® 1 “®2^ ?2^+l‘‘‘ ?l^l+2‘^'^i+3^j ( Pi ^ 
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which can be written 



+(?(1“P2^^[i|/((3iSi+(32G2)i//(?iS2)J 






A^{(A+Pj 



8 1 +^lSg) (A-i-^33^^-(>^Sg) C\-»^i )+ ^-> ( 1" )s [ fe\( ? 1 ) “ ?iA" Pg,s X" Pi ( ^ “ |)Sq] j 

^A'^l ) (A'^^gKA'^^l'*' ?i®2^ 

( 7 . 1 ) 



We note that (7.1) is not symmetrical in s^ and s^ / and this is to 
be expected since the process is not time reversible; this is one 
feature which distinguishes it from earlier bivariate exponentials. The 
backward moving average model (1.2) corresponding to (1.1) has the joint 
interval distribution which is specified by (7.1) with s^ and s^ in- 
terchanged. 

An explicit form of the joint distribution (7.1) can be obtained 
directly, rather than by inversion of the transform which is less infor- 
mative. By the structure of the model the joint distribution of 
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is a mixture of the joint distributions of 

( Pl^i+ 1 » ^ 2 ^ i +1 ^ ^ (^ 2 ^i'^ ?l^i+l ’ %%-J-l*’’ ? 1 ^ 1 + 2 '*' 4 + 3 ^ ' 

( p2^i‘*'Pl^i+l » f2^i+l‘*’^l^i+2^ * ^ P2^l‘*’?l^i+l‘^^i+2’ fe^i+l‘^?l^i+2^ * 

^ ^^i'*^^l^i+l'*’^i+2 * ^2^i+l ^ ^ ^2^l"*’^l^i+l'^^i+2 * ^2^1+1”^ ^l^i+2**’^l-{-3^ • 

with corresponding probabilities 

?i(l-P 2 )^(l-fi), ? 2 (l-(|)(l-?i). (l-P 2 )^(l-?i)^. 

These joint p.d.f.'s can be listed in an obvious notation as follov/s: 

iy 

l(xfy)“(A/|^ 2 ) ©xp(«Xx/|^P exp(“Ay/^ 2 ^ (x»y> 0 ) 



. (j^»y > 0 ) 

Vi+i • hhn :|<='- ®=^(-''y/?z)j (?2x>?iy>o) 



, Gxp(-Ax/^2^{®^^“'^y/ ^2)-e^(-Ay/^P~«xp(-Ay)+0xp[-Ay(l+ ^ ^ 
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The other terms are more difficult. For example, take 



Lat y"P2?i«+Pifi+2' “"fA+2* 

and the Jacobian eq.uals to 

Implies that 

fe^> Pi^ > Piy“P2^ 



Thus when integrate with respect to z from zero to y , 

but when B^x<S^y , we integrate with respect to z from y-62^/3j|^ to 
y . Hence we have: 



when 



p2^>^y > 0 

[exp [»Ay ( 1 



when 



[ecp[-\x(l-p2/^l)/^J«3>(-A3t/(52)j 



i-t x-||£^+Pj£j^*i. r-|£i+i+Pi£i«+«i+3- =‘-?A+2- "’4+3' ^ 

£i+3'«- 4+2“®/?i- £i+r<y-'’-">/fe> £i“HPiy-?i“-?i")P2^/4' 

and Jacobian :pi 1/4^1 * P2^^2^i‘^PliVi+l"P2^i‘‘’Pl^’“PF'"Pl’^' 
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implies that ^ 2 ^ > z^w> y-s- ^2^(3^ 1 for 

y<z+(^/^j^, integrate w fton zero to y, for y>s+^/p^» integrate w 
fron y-z«^/^j to yi and in the 2nd step^ since y<z+(^/l^^ inplies 
that z>y“^23i/|^^, if integrate z from zero to y, if 

integrate z from y“^ 2 ^/pi "to yf also y>stp^/p^r^3 <y-P 2 ^/^j^, thus if 
^<(3^y, integrate z from zero to y~P 2 ^/pi» ^ ^( 2 )“^* hence 



for the expression of f 



(x,y). 



when 



z >y- (^2^/|3 i j > ^^y > 0 . 



f [(p|+PrPlp2HP2+Pl-f2)J‘‘- ®p(-W|32) • 

[ejq>[-Ay(l/^2-^j/p|^-exp("Ay)-exi'(-Ay/Pi)+<»^(-A7(l+l/l?i+Pi/po-l/(52)]j 
When 2 ^ y-pfc/pj^ J P^y >P22S > 0 

|exp^-^y (l+l/(^ ^+P^/|32“l/p2)J “exp(“Ay/p^)j 

when z<y-P2^/pir Piy<^2^ 

f(x,y)» 0 

when z<y~Pf^/piJ ?iy>^2^^° 

f(x,y)“>? 

-ei® [-Ax(l-(|/(Jj)/(!jexp[-Ay(l+l/Pi+Pi/f2'*/P2^J j 
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The rest can be derived in a similar way. We thus see that the joint 

p.d.f . of X. /X. , will be continuous in both variables but will have 
^ 1 1+1 

different analytical expressions over the regions ^nd 

; there appears to be no compact analytical form for 
(^/Y) • This is unfortunate because it makes it difficult to 

1 ' 1+1 

derive maximum likelihood estimates of the parameters X and 3 in 
the model. 

Different bivariate exponentials also can be compared through their 
conditional properties and so we will derive these for the present con- 
tribution. Conditional p.d.f. *s are not succinct enough, and so we 
concentrate on conditional moments. These nay be obtained from (7.1). 
For instance, to obtain ^ I ' differentiate with respect to 

s , set s =0+ , multiply by -1, invert with respect to s and then 

-LX ^ 

divide by the marginal (exponential) density of • Thus 

+(pj-2P2+pj^2)exp(.A,ta-^)/(3,]/(fl-^2)] 

Examining this regression function more closely we see that E(X^|x^^^=t) 
is equal to X ^ for ^1 either 0 or 1; otherwise it 

increases exponentially from ^ constant value 

( 1 + 6 j^ 62 + 3 j^) ^ ^ as t increases. But when ^1~^ ' 

E (X^ I X^^^=t) =3/X which is the maximum value for large t. 

The conditional moment E(X^|x^^^=t) can be obtained similarly by 
interchanging s^ and s^ . 
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VIII. SOIAE BASIC ASPECTS OF THE EMAk MODEL 



By the constructions of EMAl and EMA2 model, we can write the 
general form of EMAk as: 






K,p. pj. 






w.P. 

w.p. (>-Pk)(i-|-i)Pk-a 



( 8 . 1 ) 






Methods of mathematical induction will be used to prove some basic 
properties of the EMAk model. 

1. The general closed form of EMAk (k=l , 2 , 3 , . . . ) is 



k 









5 



If 



j(k+l-n) 



» 



( 0 . 2 ) 



where 3 q ^nd are defined to be identically 1 for all i; 

(m ) 

I^ is an i.i.d. sequence of Bernoulli random variables 

(m ) 

with I. =1 w.p. {1“3 )f 0 otherwise for all m; 

1 m 

i is the serial number of the i th element of the series; 
k is the order of the process; j and n are indices. 
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Proof : 



V7hen k=l 

“(Wf w.p. Pi 



When k=2 



X «=6 ? t(3)+(3 P t(3)i( 2)+^ f T(3)T(2)Th) 






W.P. Po 



“PaV'^A+i* h“(^)Pi 

"(|V?A+i'*‘^i-i-2* (i-PgKi-Pi) 



Assume the result is also true when k=m then, when k=m+l 



V 



1+J 

n+1 J 



(m+l+l-n) 



j»0 



This completes the proof. 
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2. The distribution of the intervals {x^} are also exponential. 

-sX, 



liroofi fyr (s)“S(© !•©. 






When k*»lp 



«■ 









i-[Pi*^^xi^J "j;^ • 



V^en k-2 



A+P2s 1^2 J" A+f^Pa A+s J^A+s" 



V7hen k=m-l, the last term of (8.3) is 



X"(i-p„)(i-(l..i)- (‘-Pp.) 

(\-(3Ha+(^s) (,x+p„.p; . . . u-i-p2®'' ’ 



Assume the result is also true when k=m-l, then, when k=m the last two 
terms become 



l>.+^s)(X+p^^jS).7. (\+s) U+(^ i,g) . . . (X+PiS) ^ 
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but all the terms before these two are still the same as k=m-l, thus 



simplifying (8,4) gives 



(X^ , , , (X*^(32s} 



★ 

which is exactly the last term of f (s) when k=m-l. Hence 

X . 

1 

proved that if the result is true when k=m-l, then the result 
true when k=m. This completes the proof. 

3. The jth order serial correlation of EMAk is 









l+j“l 






« 0 



wherei ^Q<=l,and 



Proof: By definition 




we 

is also 

for 1^0^ 
for k<j 
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s are intervals of EMAk process, and have been proved to be 



where X 



(k). 



marginally exponentially distributed with parameter X . Thus 



(k) (k) 

Since and probabilistic linear combinations of i.i*d, 

exponential (A) random variables and 

(h) 

the only non-zero term of will be the sum of 

where B is a combination of 3^ and (1-3^) / for i=l,2,3,... 

Hence when k=l, j=l/ 



/ \ 1 1*"1 1 + 1-1 ^ 



1«1 1 + 1-1 
j[«ul ra *=0 ^1 



when k=2, j=l, 



i-1 



“|(1-?3)Pi(1-P2)+Pi(1-P3)(1-P2)(3o(1-?2)(1-^i) 
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When k~2, j=2, 






When k=h, assume the result is also true, then, when k=h-Hl,, j-h+1. 



i-i i+j“i 

Ic+l-o i-i 



^+l+l~a^ 



This completes the proof, 

4. All the correlations are non-negative and bounded above by 1/4. 
Proof : From above 




k-j+l 

i«i 






i+0-1 






l^J^k 



+?/i-%)(i-^.i)...(i-?3«)(i-?k^(i-6c-i)— 
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When k=l, j=l/ 






When k=2, j=l/ 



When k=2, j=2, 



min. value =0 at or 1 , 

max. value=l/4 at 3^=l/2. 

p^^^=3^(i-32)-[3i(i-B2)]^, 

min. value =0 at 3^=0 or ^ 2 ~^' 
max. value=l/4 at 3^^ ( 1 - 32 ) =1/2. 

min. value =0 at 62=0 or 3^=1 or 32 “^/ 

max. value=l/4 at 32 = 1/2 and 3^=0. 

min. value =0 at 3 ^= 0 , m=j , j+ 1 , . . . , k 

or 3 = 1 / m=k,or k-l,...or k-j+ 1 , 

max. value=l/4 at 3 =1/2 and 3 =0 for m^^n, 

m n 

where m=k,k~l,k- 2 , . . . , j . 

5. Define the i+lst element of EMAk to be 



When l<j<k, 









\+l \ 



1+2"^ ^-2^i+3 ' 



w.P. fj, 

w.p. 

w.P* 






and define the i th tlement of the k+lst order process to be , 

then we can write 




K.P. 

^ i*=0|+l f*^2f # # #) (8*5) 

H.P. 



Proof ; 



When k«l, 


xh^ta (3 £ 

^i+1 '11+1 ' 


WoP. 






“^l^i+l*‘’^i+2 • 


w,p. 




Then 




w,p. 


Pa 






w.p. 


(i-PpPi 






w.p. 


(i4)(i-fi) 


V/hen k*=2, 




W.p. 


Pa 






W.p. 


(i-Pa)Pi 






w.p. 





Then 






V-Then k=m-l, assume it is also true, then when k=m, do the same job, 

will get exact the correct result, this completes the proof. 

Note that this expression is not convenient for the purpose of 

(k) 

examining the properties of the EMAk process, since and are 

dependent; however, it may be used to generate the sequences. 
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IX. CONCLUSIONS 



1. Both estimators of 3 not very good, since the bias terms are 

/\ 

/N 

very large when 3 approaches to zero or one. But 3 looks pretty 
nice when 3 is in the interval (0.1, 0.8). 

2. Estimation of 3 in the EI4A2 process is rather difficult, because 
it is impossible to get the unique value of the estimators. 

3. In successive stages of queueing lines, all the waiting time ‘(waiting 
time in the queue plus the service time) in each stage will not be 
independent; this is the basic purpose of constructing this model, 
the size of the order k depends on the number of stages. 

4. The general expression of the EMAk model is not convenient for the 

purpose of examining the properties of the EMAk process, since 

(h) 

^ and are dependent; however, it may be used to generate 

the sequences. 



49 



APPENDIX A 



METHODS OF GETTING JOINT EXPECTATIONS 



1. The standard way to calculate the expectation of two or more jointly 
distributed random variables is to integrate the function with res- 
pect to the joint p.d.f. of the random variables; e.g. 

E(XY)» ly xy 



This is not convenient for the expectations we require. 

2. In the EMAl model, a better method of getting joint expectations is 



to write out the expressions from the basic construction and compute 
them directly. For example: 






thus 






w.p, ^ t 



v.P. ?(»-?)• 

H.P. (i-p)‘ 

By direct computation, vre have: 



w.p. (!?, 

«(l2p^+28(i^+28(S^)A^ w.p. 
-(12(5^+56pV6p^+52{a^+4^)/;<^ w.p, p(l-(3)^, 
»(4(i^+28p^4i)€(P+52^^+l6(i^*f4)/^^ K.p. (1-p)^. 
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Combine the above gives 



All the expressions listed in APPENDIX B were computed in this way. 

3. Take the derivative of the Laplace transform of the joint p.d.f. with 
respect to s^, and then setting s^ equal to zero will also give 
the joint expectations, e.g. Lawrance and Lewis gave the general ex- 
pression of Laplace transform of the joint p.d.f. of r adjacent 
intervals. [Ref. 1, p.l7] 

Converting it gives: 

f V 

y X X 







S2-i-pB^)(x-tT3s^+^^P 







Take the derivative of this with respect to s^ twice, s^ once, 

twice, and s^ once. Then set s^=0 (i=l, 2,3,4) to get 
2 2 

E(X.X. ^X. -X. -) . Note that when the order of the derivative is 

X 1+1 1+2 1+3 

odd, one should change the sign of the expression. This is a messy 

job by hand but one done easily by computer. 

4. An alternative way is to use "cumulants*' or "semi-invariants'* 

[Refs. 8, p.253 and 11, p. 55-93]. Let L be the Laplace transform 

of the joint p.d.f. and L*=log L. Let 1^*2112 derivative 

of L* with respect to s^^ twice, s^ once, s^ once, and s^ twice. 

2 2 

Since L*j^=L^/L and L*^= ^ L(0)=1 , these imply that 

■ L*i( 0)=L^(0)= -E(X) and L*^ (0) =L^ (0) - [L^ (0) ] var(X). 
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If we danote K.__, and E(xJ E.^ we get from this 



relationship the following 

,2 



®ir '=11+ >=r > 

®2r -'=21^1 (2=1 l-«20>-«l> 

® 12 “ ->= 12 -*l(®ll-® 02 )-''=l' 

®22“'=22+®i('=12-®2i)+24i«20'=02+®i('==11+^20)*1' 

®13“'=13*l(‘=03+3Ki2>+31=iiK(32+3Kf(Kii+Kg2)«^ 

V’'3l'*l^V^21>+31=iiK,o-f3Kf(K,j«,o)-«^' 



where 



'=1“ '=10" '=01" -'/a " -®0l" '^lO. 



'' 1=0 

‘= 20 " ‘= 02 "=/A^* 

Kj 2 “( 2 ti^- 2 p)/>?, 

K 2 j=( 2 P?- 2 ^)/;^ 3 , 

K22-(6j^-6p,")/x*, 



M’PENDIX B 



LIST OF USEFUI. JOIK’T EXPECTATIONS 



E(x.x.^,) = (l+B-eN/x^ 

E(X^X.^,) = (2+'>e-2B"-2BN/>'’- 
E(X.X^^,)=(2+2B-2B’)/X’- 

E(XU? ) = (4 + 8B + 83^-146^-2B'' )/X\ 

E(X?X.^^ ) = (6 + 24B-188='-68'*)/X" . 

E(XiX^!^^) = (6+123"-68'-68-)/XV 

E(X?X^_j_^) = ('12+.363 + 603^-''183^-363'‘-123M/X^. 

£(X2x?^i) = {‘i2 + 24 3+243^ + 123^-^83‘‘-123^)/X^. 

•E(X?X?^^)=(36 + 1083 + 1 80 3^ + 2163^-3243‘*-1443^-363'^)/X . 



E(XlX. ^) = (24 + 963-243^-24 3^-483‘*+243^-24 3M/X^. 

ECX^X*! ^) = (24 + 243-243^+483‘*-4 83M/X^. 

E(X!x'.^^) = (1 20 + 6003-1 203^-1 203^-1 203" -1 203^-1 203M/X^ 

E( XiX^!.j.^) = (1 20+1 203-1 203" ) /X" . 

E(X^X^^^ )=( 48+963+963^ +483 ^+403" -24 03"-483" )/X" • 

E(X"X^ )=(4 8+1923+4 323^- 24 03^-1923"-1443"-4 83" )/X"- 
i i -t- r ' 

£^(X$X" -)=( 57 6+2 304 3+51 843^+86403^+1 2 0963" -167043" -80643" 
11 + 1 

-28803’ "5763")/X® . 
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m 




E(X.X. ,X ) = (l+3-3')/X^ 

' 1 1+1 1+2 

E(XiX^^.lX. + 2) = {2 + 6B-8B'+2B“)/X". 

E(X?X^ tX. J = (4 + 16B + 363^-963' + 963"-883^+363M/X^ 

E ( X? X • X^ + 2) = + ^ 23-4 3^-1 43' + 1 23“ -63" )/X". 

E(X.X^ . X? . p)=(4+43+203^-203"+83"-1 23")/X" . 

E(X^X^^.^X? + 2) = (S + 32 3+483^-563'.-4 03“+83" + 83')/X". 

E(X.X? + ^ + ■ 

E(X^X?^^X.^2)"^^ 2 + 953-36 3^ + 603"-1 563“ + 204 3"-1 683M/X^ 
E(X.X! ,X? ,.)=(12+1683-2763^+3483"-3123“+723")/X" . 

E(X. ) = (4 + 1 63 + 683 ^ -1 323 " + 1 043“ -1 603 " + ! 243 " + 43 ’ 

-243M/X". 

+123M/X". 

^^^‘ 1^1 + 1 ^*+ 2 ^^ ) = {4 + 243 - 443 ^ + 803 "- 1083 “ + 603 ^- 203 '" + 123 ’ 

‘■*' 1 i+3 

-43M/X". 

E(>^iX- + ^Xi^2^i + 3) = (^ + l^^+^^^-368" + 5 23“-643" + 363"-l<53’ 



E(X-X^_^1 X._j^2^i+3) = (2+83-4B^ + 26^-143'* + 10B^-2eM/X^ 
E(X.X.^,X?^.X. ,) = ( 2+83 + 23" -263^ + 263“ -63^-1 23’+83®)/X^ . 

1 l+l 1+^: 1+3 

E ( X. X^. + 3 ) =^(2 + 63-23" "43^-23“' -23^ )/A^ 

E(X.X‘! .X. ) = (24 + 1 203+483"-963^-1683^ + 963®)/X®. 

• 1+1 1+2 
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